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A method for encoding image pixels, a method for 
processing images and a method for processing images 
5 aimed at qualitative recognition of the object 
reproduced by one or more image pixels 

The invention first relates to a method for 
encoding pixels of digital or digitized images, aimed 

10 at making the information content of each pixel 
available to automatic image processing systems, 
particularly designed for image recognition with 
reference to the objects reproduced therein. 

The term digital is intended to define an image 

15 obtained by imaging apparatuses whose output is an 
image in digital format, i.e. digital cameras, Nuclear 
Magnetic Resonance imaging apparatuses, ultrasound 
imaging apparatuses and other imaging apparatuses. 

The term digitized images is related to images 

20 obtained by substantially analog systems, providing an 
analog image which is further scanned by means of 
devices known as scanners, regardless of whuther the 
latter are hardware devices, i.e. devices for reading 
an image which is physically printed on a medium, or 

25 software devices, i.e. designed to sample an image, 
provided in the form of set of signals and to turn it 
into digital signals. 

The increasingly extensive use of digital images 
allows to have said images in the form of numerical 

30 data, ready for further processing. 
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Regardless of whether the image is directly 
obtained digitally or acquired in an analog manner, by 
traditional systems, to be further digitized, e.g. 
scanned by digitizing devices, i.e. scanners, a digital 
5 image is composed of a set of image dots, the so-called 
pixels, which may have different brightness conditions, 
i.e. different gray scale tones and, in color images, 
different colors. Each pixel of an image also has a 
well-defined position whereby the digital image may be 
10 represented by a two- or three-dimensional matrix of 
elements Pi , j , each corresponding to a predetermined 
pixel of the pixel set that forms the image, the 
element Pi,j being a variable which assumes the 
brightness and/or color value associated to the 
15 specific pixel. 

When the range is restricted to black and white 
images, the different pixel-associated brightness 
values are represented by a gray scale extending, from 
black to white through several different intermediate 
20 gray levels, whose number may be user-defined, based on 
the capabilities of the digitized imaging apparatus 
and/or of the display device. 

In the case of a three-dimensional matrix, the 
discrete image unit element is generally referred to as 
25 a voxel and the three-dimensional matrix is composed of 
elements Vi , j , k . 

Therefore, from the technical point of view, a 
digital image has a unique equivalent in the form of a 
data matrix which forms a virtual image and, as such, 
30 has a structure that is potentially adapted for image 
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processing by systems or methods which use algorithms, 
whether provided by software loaded in computers or by 
dedicated hardware for accomplishing specific functions 
on the image matrix. 
5 Nevertheless, from a logical point of view, the 

information contained in each isolated pixel Pi,j or 
voxel Vi,j,k provides nothing but the simple indication 
of its brightness value, i.e. the gray scale value 
corresponding thereto, hence it has no meaning 
10 wheref rom image information may be extracted, and only 
acts as data for controlling the display device, which 
may be and actually is handled during the imaging 
process to adjust the general aspect of the image, 
e.g. contrast and/or brightness and/or specific color 
15 as defined based on user-selected functions, depending 
either on objective or subjective data. 

The image obtained thereby, as regards the shapes 
and characteristics of the objects reproduced by pixels 
in the different image portions derives from the 
20 relation of each image pixel with the surrounding 
pixels. Therefore, in order to allow image processing 
to not only adjust the individual pixels to improve the 
quality of the displayed image, it is necessary to 
define the relations between each pixel and the pixels 
25 around it. At present, no rule exists to determine such 
relations, except those defined on the basis of 
assumptions or presumptively defined rules, based on 
the specific characteristics of the objects reproduced 
by the image. 

30 Therefore, the invention is based on the problem 
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of providing a method for encoding image pixels, which 
allows to account for the relations of each pixel with 
the pixels around it, substantially regardless of the 
peculiar characteristics of the object specifically 
5 reproduced in the image, i.e. a method that can be used 
to provide an image data set, particularly adapted for 
an image processing procedure aimed at recognizing at 
least some characteristics of the objects represented 
in the image, as well as of the shapes of these 
10 objects. 

An additional object is to provide an encoding 
process as mentioned above, which is simple and 
requires neither complex processing steps, nor long 
processing times, and does not cause the hardware 

15 required to store the encoded data to be overloaded. 

The invention achieves the above purposes by 
providing a method for encoding pixels of digital or 
digitized images, wherein each pixel of the pixel set 
which forms the image is uniquely identified with a 

20 vector whose components are given by the data of the 
pixel to be encoded and by the data of at least one or 
at least some or at least all of the pixels around the 
pixel to be encoded, which pixels are disposed within a 
predetermined subset of pixels included in the total 

25 set of pixels that form the image. 

As a first approximation, the components of the 
pixel identifying vector are determined by selecting, 
as pixels surrounding the pixel to be identified, all 
the pixels that are directly adjacent to said pixel to 

30 be encoded. 
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The components of a pixel identifying vector may 
be also extended to at least one or at least some or 
all of the pixels which surround the pixels directly 
adjacent to the pixel to be encoded. 
5 Theoretically, no limit is imposed to the number 

and position of pixels around the pixel to be 
identified, which may be used to define the components 
of the pixel identifying vector. 

The components of the identification vector 

10 corresponding to the pixel to be identified and to the 
surrounding pixels are arranged in such a manner as to 
reflect the arrangement of the pixels within the pixel 
matrix which forms the image, with reference to a 
predetermined pixel reading sequence, for forming said 

15 vector . 

Particularly, the components of the identification 
vector, corresponding to the pixel to be identified and 
to the surrounding pixels are arranged in such a manner 
as to correspond to the distance relation of said 

20 pixels with one another and with the pixel to be 
encoded, with reference to a predetermined pixel 
reading sequence, for forming said vector. 

The components of the identification vector are 
arranged in such a manner that the pixel to be 

25 identified has a central position which corresponds to 
the one taken in the image pixel set, obviously as 
related to the surrounding pixels, which pixel set has 
been selected for determining the identification vector 
components . 

30 The methods includes the generation' of an 
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identification vector for each pixel which forms the 
digital or digitized image. 

By this arrangement, the virtual image composed of 
a data matrix which corresponds to a set of virtual 
5 pixels, i.e. a set of data having the same position as 
that of real, actually displayed image pixels, is 
turned into a matrix in which each element has , at a 
certain pixel location, the identification vector 
therefor, which in turn has the numerical structure as 

10 defined above. 

Since the identification vector includes 
components given by the data associated to a certain 
predetermined n umb er of pixels surrounding the pixel to 
be identified, the latter is defined not only by the 

15 numerical value corresponding to the brightness 
thereof, but also by the numerical values that 
correspond to the brightness of the surrounding pixels, 
which were selected to form the identifying vector 
components . Hence , the matrix of pixels , i.e. of 

20 brightness data associated to the pixels is changed 
into a set of vectors. 

The pixel identifying vector may be also extended 
to other components, e.g. the values of the selected 
pixels and of the pixel to be identified at different 

25 instants of time. This is advantageous when, for 
instance, different digital or digitized images of the 
same frame, acquired at different instants, are 
available. In this case, the vector will be associated 
to a succession of different sets of components, 

30 comprising the value of the pixel to be identified and 
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the values of the selected pixels around it, each set 
being determined by an image acquired or referred to 
the same frame at different acquisition instants. 

Preferably, the component sets are ordered within 
5 the identification vector in a succession corresponding 
to the time sequence of capture thereof. 

The above clearly shows that the encoding method 
of the invention, besides allowing to identify each 
pixel based on its numerical value and on the relation 

10 of said pixel to a certain number of surrounding 
pixels, also extends this identification to the time 
variation of said pixel to be identified and to the 
time variations of the relations of said pixel to be 
identified to the selected surrounding pixels. Thanks 

15 to the encoding method according to the invention, a 
numerical description may be provided for each image 
pixel, even for sequences of images representing moving 
objects, any change caused by the movement of the 
object being contained in the identification vector. 

20 The method as described above may be easily 

implemented both for two- and three-dimensional 
imaging. In the latter case, the number of components 
of the identification vector considerably increases, in 
a cubic progression, if all the pixels which form the 

25 increasingly distant shells around the pixel to be 
identified are to be accounted for. 

The pixel selection pattern around the pixel to be 
identified and whose data shall form the components of 
the identifying vector may vary depending on actual 

30 needs . 
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According to a further embodiment of the method 
for encoding image pixels, instead of considering as 
the relevant minimum image surface to be coded only one 
pixel a group of adiacent pixels may be considered. In 
5 a square sub matrix of pixels for coding, the min imum 
image area to be coded can be formed by the four center 
pixels of the said sub matrix. In this case the at 
least one value assigned to the group of four pixels in 
the coding vector or matrix is formed by a linear or 
10 non linear combination of the brightness of the said 
four adiacent pixels. 

The value of the group of pixels to be coded as 
the minimum image area may be a combined value 
comprising several parameters each one considering for 
15 example a linear or non linear combination of the 
brightness of the said four grouped pixels, such like a 
mean value of the brightness of the four' grouped 
pixels, and statistical values such as brightness 
variance of the four grouped pixels . As numerical 
20 values of the said grouped pixels considered a mini mum 
image area also the colour values of the four grouped 
pixels might be considered if the image is a clour 
image and even the variation relatively to time of the 
said brightness and cloir values. Also color values of 
25 the grouped pixels might be in the form as a linear or 
non linear combination of the color values of the 
single pixels of the group and/or to values 
corresponding to statistical parameters such as 
variance or the like. 
30 The variation of the brightness values and or of 
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the color values of the grouped pixels might be 
considered as the variations relatively to time of the 
linear or non linear combinations, such as mean values 
or other statistical parameter elatively to time. 
5 In the identification or coding vector for such a 

minimum image area formed by a certain number, for 
example four grouped pixels, might comprise similarly 
to the above described identification vector the 
brightness and or color values and/or their variation 

10 relating to time of a certain number of surrounding 
pixels . 1 

In this case of a minimum image area to : be coded 
to alternatives might be choosen. In the first 1 one each 
selected pixel surrounding the grouped pixels forming 

15 the minimum image area to be coded is considered alone 
or per se. 

In a second alternative embodiment the selected 
surrounding pixels are grouped similarly to the ones to 
be coded thus forming surrounding minimum image zones 
20 the values of this surrounding image zones being 
defined by linear or non linear combination or by other 
statistical functions of the brightness of the signle 
pixels being grouped as a minimum image surrounding 
zone. 

25 The above disclosed embodiment has the advantage 

to reduce calculation time in the case the pixels are 
very small relatively to the subject reproduced by the 
image, so that within the area of only one jpixel no 
variation of the structure of the imaged subject may 

30 occur. 
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The invention also relates to an image processing 
method, particularly aimed at recognizing objects 
and/or object shapes, in an image in which pixels are 
encoded into identification vectors. 
5 The method for processing digital or digitized 

images includes the following steps: 

Encoding different digital or digitized ima ges 
into pixel identifying vectors, with image objects 
being identified for the selected types and qualities, 
10 and associating each identification vector to the 
corresponding known type of object or to the known 
quality that are actually reproduced by each pixel 
identified by said identification vector, with 
reference to a predetermined list of different types or 
15 qualities . 

Generating a teaching database for an expert 
processing system, comprising the binomials formed by 
said identification vectors and by the associated type 
or quality of the reproduced object; 
20 Actually teaching the expert processing system, by 

entering the teaching database therein; 

Encoding the pixels of a not otherwise evaluated 
image by identification vectors associated to each 
pixel ; 

25 Entering said image pixel identifying vectors in 

the processing system to obtain, at the output of said 
processing system and as a result of the processing, 
the type or quality of the object represented by the 
image pixels. 

30 The process of recognizing a quality or a type of 
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object and assigning it to a pixel identifying vector 
is not complex, because it only is a comparison. The 
difficulty lies in the great number of pixels, hence of 
the vectors to be compared, and in that the vectors 
5 have a considerable number of components . When 
accounting for the processing time, however fast, of 
each step in which the identification vector for a 
pixel to be recognized is compared with the 
identification vectors for pixels included in the basic 

10 knowledge or teaching database for the expert system, 
total times are extremely long and unacceptable in 
practice. This field of application is particularly 
suitable for particular processing algorithms : and more 
precisely for the well-known neural networks. 

15 Nevertheless, it shall be understood that, while 

the use of a neural network as a processing system is 
the preferred embodiment, the invention is not limited 
to said algorithm, but may address any type of 
algorithm for comparing the identification vectors of 

20 the image pixels to be processed with the teaching 
database, such as a discretizing algorithm which makes 
a dull comparison and decides whether the 
identification vector belongs to one or the other type 
of object or feature amongst the various possibilities . 

25 As will be apparent hereafter, the pixel encoding 

method according to this invention provided highly 
reliable and accurate results, i.e. higher than is 
currently expected. 

These algorithms can rapidly converge toward the 

30 correct solution or to a solution to be statistically 
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considered as the best possible solution, by also 
accounting for the considerable variances of the 
identification vectors for the same object type or 
quality . 

5 The result provided by the expert processing 

system may be viewed by simply printing or displaying a 
list. As an alternative thereto or in combination 
therewith, the processing result may be highlighted by 
associating a color to each type or quality and by 
10 representing the solution over the digital or digitized 
image with each pixel of the digitized image being 
assigned the color of the corresponding type or quality 
of the represented object, as determined by the expert 
processing system. 
15 It shall be noted that the teaching step, based on 

either different images of the same frame at different 
times or on images of different frames or objects whose 
type or quality is one of the predetermined options, 
allows the expert processing system, particularly a so- 
20 called neural network to learn what the aspect of the 
identification vector should be for a particular object 
or a particular quality with the highest variance of 
this aspect. 

It shall be also understood that the recognition 
25 of the reproduced objects and/or qualities is 
independent from the global processing of the image and 
that it is performed pixel after pixel with no 
reference to what the pixel set represents within the 
image . 

30 These two characteristics are of basic importance. 
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By providing as much variance as possible for the 
identification vectors for pixels that represent a 
certain object type or quality, the processing system 
is allowed to recognize more accurately and reliably 
5 whether an identification vector, hence a pixel, 
belongs to a certain type of object or to a certain 
quality . 

Pixel-based processing allows to substantially 
unlink the recognition of a pixel identifying vector as 
10 belonging to a certain object type or quality from the 
imaged subject. 

The image processing method provides other 
advantages . 

A first additional advantage consists in that the 
15 list of object types or qualities may be modified 
anytime, i.e. restricted or extended, without affecting 
the previous teaching process, by simple integration 
in the teaching database for the processing system. It 
is also possible to restrict image processing to only 
20 recognize some of the types or qualities of the imaged 
object among all the qualities or types of the teaching 
database, without affecting any further extension 
thereof . 

Moreover, with use, the database including the 
25 knowledge acquired by the system may be increased, 
thereby improving knowledge, expertise, hence 
reliability and accuracy of the processing system. 

Objective evaluation of pixel characteristics 
allows to avoid any human image recognition and 
30 interpretation errors. 
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By a targeted selection of the object types and/or 
qualities to be recognized and the generation of 
adequate teaching databases , the same processing system 
may be used to accomplish different functions . 
5 Besides simply recognizing object types or 

qualities, it is possible to generate teaching 
databases which allow to correct defocused images or 
accurately overlay two digital images of the same 
subject, acquired with different imaging methods, e.g. 

10 by Nuclear Magnetic Resonance imaging, ultrasound 
imaging or radiographic or photographic imaging. 

Yet another advantage provided by the recognition 
method of this invention consists in allowing to limit 
image definition during acquisition, thereby obtaining 

15 identical or even better results as regards the 
possibility to evaluate the acquired image thanks to a 
better and more accurate recognition allowed by the 
method, as compared with human eye potential. This 
provides an important advantage, a lower resolution 

20 involving a reduced duration of imaging, e.g. by 
Nuclear Magnetic Resonance or by ultrasounds or other 
similar means. This not only allows to reduce the costs 
required for fast imaging and image reconstruction 
apparatuses, but also has positive implications, namely 

25 for the comfort of the patient, who does not have to 
keep still for very long times. 

A particular application of the image recognition 
method of the invention consists in the automatic 
recognition of tissue types from the diagnostic images 

30 acquired by Nuclear Magnetic Resonance imaging, 



- 14 - 



WO 03/077182 PCT/EP03/02400 



ultrasound imaging, radiography , etc. 

In this case, the method includes the following 
steps : 

- generating a database for teaching the expert 
5 processing system based on pixel identifying vectors 
obtained by encoding well-known digital or digitized 
diagnostic images, whose pixels have been previously 
associated by an expert to a tissue type, which pixel 
identifying vectors are uniquely associated to the 
10 corresponding known tissue type; 

- Teaching the expert system by entering the 
teaching database therein, as well as the modes 
associated to the processing algorithm type; 

- Encoding an image or a time sequence of images 
15 of the same frame, into pixel identifying vectors 

according to the method of this invention, which image 
or sequence is digitally acquired or has been digitized 
but not interpreted; 

- Entering pixel encoding vectors for the non 
20 interpreted image entered into the processing system, 

which processes the tissue type or the tissue quality 

for each pixel identifying vector and displays the 

! 

result thereof. 

Particularly, the result is displayed as color 
25 assignments, where predetermined colors are assigned to 
the different types of object or to the different 
qualities of the pixels which have been found to belong 
to an object type and/or quality. 

It shall be noted that in this case the method has 
30 no diagnostic function, but generates considerably 
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reliable indications for the physician or for the 
technical personnel responsible for the evaluation of 
the acquired image. No direct treatment suggestion is 
provided, but simply an indication of a type of tissue 
5 which is highly likely to be found in the image. The 
actual and total certainty of the result for final 
diagnosis requires both the image to be read and 
interpreted by qualified personnel and other cross- 
checks to be performed by other diagnostic methods. 
10 Nevertheless, as will be more apparent from the 

following, it is not easy to read and interpret a 
diagnostic image, like a radiographic plate, an 
ultrasound image or a Nuclear Magnetic Resonance image, 
particularly when the diseases reproduced in the image 
15 have a very small extension. The instrument provided by 
this invention allows to reliably signal potential 
pathologic elements, while reducing the risk of 
misinterpretation, or preventing the same elements from 
being misinterpreted or even from not being seen by the 
20 physician or qualified personnel. 

Further improvements of the invention will form 
the subject of the subclaims. 

The characteristics of the invention and the 
advantages derived therefrom will appear more clearly 
25 from the following description of a non limiting 

embodiment, illustrated in the annexed drawings, in 

i 

which : 

Fig. 1 shows a simplified digital or digitized 
image pixel encoding scheme according to this 
30 invention, in a two-dimensional space. 
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Fig. 2 is a scheme as shown in Figure 1, referred 
to a three-dimensional imaging space. 

Fig. 3 shows a scheme of the identification vector 
for the same pixel in a time sequence of digital or 
5 digitized images. 

Fig. 4 shows a block diagram of the inventive 
image processing method, which operates based on the 
pixel encoding method as shown in the previous figures. 
Fig. 5 shows a data table and a chart of the image 
10 processing results for the image as shown in Fig. 8 or 
in Fig. 11, obtained by Nuclear Magnetic Resonance 
imaging, and in which the processing system was 
operated with a teaching base only comprising two types 
of tissues, i.e. benign tumor tissues and malignant 
15 tumor tissues. 

Fig. 6 shows a data table, and a corresponding 
chart 6f the image processing results for a Nuclear 
Magnetic Resonance image, as seen in Fig. 8 or in Fig. 
11, in which the processing system used a teaching base 
20 comprising three types of tissues, i.e. benign tumor 
tissue, malignant tumor tissue and normal tissue. 

Fig. 7 shows a data table and a corresponding 
chart of the image processing results for a Nuclear 
Magnetic Resonance image, as seen in Fig. 8 or in Fig. 
25 9, in which the processing system operated with a 
teaching base comprising four types of tissues and an 
additional object type, i.e. benign tumor tissue, 
malignant tumor tissue, normal tissue, muscular tissue 
and background image. 
30 Fig. 8 shows a first Nuclear Magnetic Resonance 
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image, in which the presence of a benign tumor tissue 
is outlined by a white ring. 

Fig. 9 shows the same image as Figure 8, but 
processed with the method of the invention and with the 
5 mode in which only benign tumor tissues are recognized, 
in which the system has displayed the result on the 
originally acquired image by assigning a different 
aspect to the pixels which have been found to belong to 
the one or the other tumor tissue . 

10 Fig. 10 shows the same image as Figures 8 and 9 

once it has been processed according to this invention, 
the system having been taught to recognize the four 
types of tissues and the background, and the system 
having been prompted to display the originally acquired 

15 image by assigning different aspects to the pixels 
which have been found to belong to the different tissue 
types and/or to the background. \ 

Figs. 11 and 12 are another Nuclear Magnetic 
Resonance image containing a malignant tumor tissue, as 

20 outlined by the white ring, and an enlarged image of 
said region containing the tumor tissue respectively. 

Fig. 13 is the same image as Fig. 11, representing 
the result of image processing according to this 
invention, operated for recognition and differentiated 

25 display, on the same acquired image, of five different 
object types, including four tissue types- (benign 
tumor, malignant tumor, normal and muscular) and a 
background type. 

Fig. 14 shows the inventive processing method in 

30 combination with steps to display pixels corresponding 
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to a resolution below the human eye and to a resolution 
level with or worse than that of the human eye. 

Figure 1 shows the inventive encoding method in a 
highly simplified manner, in the case of- a two- 
5 dimensional digital or digitized image, i.e. consisting 
of a set of pixels (image unit elements) . 

The example shows a pixel of the pixel set, 
denoted as 5, which is designed to be encoded in such a 
manner as to make the information available for any 

10 type of treatment, particularly for processing. 

In this case, the image may comprise any number of 
pixels and the steps of the method, as shown with 
reference to the pixel 5 of Figure 1 are executed for 
every pixel of the image. In the inventive encoding 

15 method, the pixels around the pixel are used to form an 
identification vector for the pixel 5. The surrounding 
pixels may be selected according to predetermined rules 
which may lead to different selections of surrounding 
pixels, as components of the identification vector, 

20 both as regards the number of the surrounding pixels to 
be selected as components of the identification vector 
and as regards the location of these surrounding pixels 
relative to the pixel to be encoded, in this case to 
the pixel 5. 

25 One of the most obvious selections consists in 

using, as components of the identification vector for 
the pixel to be encoded, all the pixels directly 
adjacent to the pixel to be encoded, that is, in the 
notation referred to pixel 5 of Figure 1, the 

30 surrounding pixels 1, 2, 3, 4 and 6, 7, 8, 9. : 
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In black and white or gray scale images, the value 
represented by each pixel is given by a brightness 
value of the corresponding pixel, i.e. a gray value in 
a gray scale extending from white to black through a 
5 certain number of intermediate levels, which may have a 
different number of gray tones, depending on the 
quality of the digital image with respect to the color 
resolution of the imaging apparatuses . 

Depending on the type of color encoding, in color 
10 images, each pixel may also have one variable for 
indicating the color to be assigned thereto. 

The example of the following figures will be 
limited to black and white or gray scale images, to 
better explain the steps of the method. The extension 
15 to pixel color indicating variables is an obvious step 
for those skilled in the art, which eventually involves 
the presence of a greater number of components in the 
identification vector. 

Figure 1 shows the structure of the identification 
20 vector for a pixel with reference to pixel 5. 

The vector comprises, in the same pixel indexing 
sequence within the pixel matrix, all the pixels which 
constitute the vector components, starting from pixel 1 
and ending with pixel 9. In this case, the pixel 5 
25 located at the center of the pixel matrix appears to 
occupy a central place in the sequence of the 
identification vector components. 

The manner in which the pixels designed to form 
the identification vector for a pixel to be encoded are 
30 indexed is not relevant per se; what is important is 
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that the selection of this manner is consistently and 
accurately followed for all encoding processes, 
otherwise no comparison between two pixel vectors would 
be possible, since the vector components would have 
5 different arrangement orders. 

Therefore, it shall be noted that, for this 
encoding operation, the identification vector for pixel 
5 does not only contain gray-scale brightness, i.e. 
pixel aspect information about the pixel to be 

10 identified, but also brightness information about the 
pixels around it. 

This vector structure is based 'on the 
acknowledgement that the content of an image is not 
recognizable based on the aspect of an individual 

15 pixel, but based on the relation between the aspect 
thereof and the aspect of the surrounding pixels. In 
practice, each image dot is not important ' per se, 
unless it is evaluated with reference to the aspect of 
the surrounding dots or areas. Even from the visual 

20 point of view, what is shown in an image is recognized 
on the basis of a relative evaluation between the 
different areas of the image. 

As mentioned above, the selection of the 
surrounding pixels to create the identification vector 

25 for the pixel to be encoded is not governed by any 
specific rule. 

For example, it is possible to increase the number 
of surrounding pixels to be accounted for to generate 
the identification vectors, by using, as vector 

30 components, at least some or all of the pixels of pixel 
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rings surrounding the central pixel to be encoded, at 
increasing distances from the central pixel to be 
encoded . 

As in the illustrated example, it is possible to 
5 account for all or some of the pixels of the pixel ring 
which externally surrounds the pixel ring directly 
adjacent to the central pixel 5 i.e. the pixels 1, 2, 
3, 4, 6, 7, 8, 9. 

In this case, the number of vector components 
10 increases drastically, and overloads the identification 
vector processing conditions. If the identification 
vector for pixel 5 is arranged to comprise, for 
instance, all the pixels that externally surround the 
illustrated 3x3 pixel matrix, the number of 
15 identification vector components increases from 9 to 25 
components . 

In this case, processing might obviously provide a 
more precise solution. 

Furthermore, said additional pixels at a longer 
20 distance from the pixel to be encoded may be suitably 
weighted, possibly also in a different manner from each 
other, to attenuate the effect thereof on the 
identification vector. » 

Fig. 2 shows the situation of a three-dimensional 
25 image, in which the central pixel 14 is encoded by an 
identification vector which has, as components, the 
values of all the pixels directly surrounding it and 
subtending a 3x3x3 cube, whereby it includes 27 
components . 

30 The considerations proposed for the two- 
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dimensional embodiment also apply to the three- 
dimensional embodiment. This shows more clearly the 
overloaded processing of the identification vector when 
other pixels are accounted for, e.g. those of a three- 
5 dimensional cubic pixel shell which encloses the 
illustrated cubic set. In this case, the number of 
components increases in a cubic progression, from 27 
pixels to 125 pixels, if all the pixels of a 5x5x5 cube 
are considered in the identification vector. 

10 According to an additional characteristic of the 

invention, the pixel vector encoding method allows to 
also integrate the behavior through time of the pixel 
under examination in the identification vector, when a 
sequence of images of the same frame are available. 

15 The sequence of images may be composed, for 

instance of frames of a motion picture or of individual 
images of the same frame as taken at successive 
instants . An example of imaging of the same ' frame at 
successive instants consists in diagnostic ultrasound 

20 imaging of contrast agent perfusion. In this iase, the 
perfusion of contrast agents pushed by the flows of 
vascular circulation is imaged by injecting contrast 
agents in the anatomic part under examination at the 
instant Tc, and by subsequently imaging the same part 

25 at predetermined time intervals. Time variations of 
the image allow to check the presence of contrast 
agents, after a certain period from the injection 
instant. These images may provide useful deductions 
and/ or information to check the presence of : vascular 

30 and/or tumor diseases. 
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In the above case, the recognition of the 
reproduced object is not only based on the aspect 
thereof, but also on the time variation of said aspect. 
Therefore, the pixel vector encoding process aimed at 
5 including, in the identification vector for each pixel, 
all the data characterizing the quality or type of the 
object reproduced by an image pixel must especially 
account for the time variation of the encoded pixel. 

In this case, the identification vector for a 

10 predetermined pixel, e.g. pixel 5, with reference to 
the embodiment of Figure 1, contains a set of 9 
components, relating to pixels 1 to 9 in the proper 
time sequence, for each instant whereat the 
corresponding image has been captured. 

15 The illustrated embodiment show six images of the same 
frame as acquired at the instants T=0, T=l , T=2, T=3, 
T=4, T=5. Moreover, the embodiment has been developed 
with reference to the acquisition of a sequence of 
ultrasound images of the same anatomic part, performed 

20 after the injection of contrast agents. The instant TC 
whereat contrast agents are injected is denoted by the 
arrow TC. 

The identification vector accounts for pixels 1 to 
9 of the three images acquired at the instants T=0, 

25 T=l, T=2 and in these conditions the identification 
vector already has 27 components. When all the 6 images 
of the time sequence are accounted for, the components 
will increase to 54. This only relates to an encoding 
process which accounts for a 9 pixel matrix, in which 

30 the pixel to be encoded is the central pixel. When the 
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encoding process is intended to include the pixels 
surrounding the pixel to be encoded in a 5x5 pixel 
matrix, i.e. having 25 components of the identification 
vector for each instant, provided that all the images 
of the sequence are considered, each identification 
vector will have 150 components. 

In the case of a three-dimensional image as shown 
in the example of Fig. 2, in which the identification 
vector for a pixel,, with surrounding pixels of a cubic 
3x3x3 pixel space, has 27 components, the encoding 
vector according to the example of Figure ! 3 would 
include, for all six images of the image time sequence, 
162 components. If encoding is extended to a 5x5x5 
pixel three-dimensional space, the components of the 
identification vector for the pixel will increase to 
750. 

It shall be noted that while the inventive 
encoding method may be followed in a simple and fast 
manner, it allows to identify the characteristics of an 
image pixel through its value as well as in ' relation 
with its surrounding pixels, and also with reference to 
time variations of the pixel to be encoded and of the 
surrounding pixels. 

It shall be further noted that this encoding 
method only accounts for pixels, and of a substantially 
restricted examination field, which is independent from 
the subject of the image and of the encoding purpose. 

Obviously, encoding times for an image or a 
sequence of images strictly depend on the image size, 
in terms of number of pixels. 

- 25 - 
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According to a further embodiment of the present 
pixel coding method, instead of considering an image 
formed by single pixels, for coding purposes a minimu 
image area of different size may be defined which is 
5 formed by a more than one adiacent pixel. 

So referring to the above described method and 
particularly to figure 1 to 3, with 5 in fig. 1 and 14 
in fig. 2 there is not identified a single pixel but 
the said minimum image area formed by a certain number 
10 of pixels , for example by a matrix of four adiacent 
piels or of 9 adiacent pixels. 

In this case the value of the said minimum image 
area formed by grouped adiacent pixels may be 
calculated as a linear or non linear combination and as 
15 the value of one or more statistical functions of the 
of the brightness and or color values of the single 
pixels grouped together for forming the said minimum 
image area. 

A simple example would consider the mean of the 
20 brightness values of the single pixels forming the 
minimum image area the variance thereof. To *this the 
information relating to the color of the pixels could 
be add also in the form of a mean and or of a: variance 
value. Furthermore also in this case the time 
25 dependency of the values relating to brightness and/or 
color could be add similarly as disclosed above 
relating to fig. 3. In this case the time dependency of 
the combination and of the statisitical function of the 
brightness and or color values of the single pixels 
30 will be considered, i.e. the variation relatively to 
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time of the mean value of the brightness or color 
values of the single pixels forming the minimu image 
area and or the variation relatively to time of the 
value of the statistical fuction. 
5 As selected neighborhood pixels for the pixel 

vector identifying the said minimum image area, there 
might be the choice between to alternatives . 

In one alternative the selected piels of the 
neighborhood are considered per se. 

!0 In the second alternative also the neighborhood 

pixels are grouped together for forming selected 
minimum image neighborhood areas. To explain more 
clealrly the idea, if figure 1 or 2 are considered the 
image area indicated as pixel 1 to 4 and pixel 6 to 9 

15 in the example of fig. 1 are not single pixels as 
described in the previous example but are formed by a 
certain number of adiacent pixels. This certain number 
of pixels might be the saome as for defining the minimu 
image area to be coded or it might be a different 

20 number of pixels as the one grouped for forming the 
minimum image area to be coded. 

The advantage of such a oding method condidering 
minimu image area comprising more than ome pixel will 
speed up the coding computational time and is useful 

25 and will give not rise to errors particulallry in the 
case the subject being imaged does not show any 
structural change within an area of several pixels, or 
the image resolution is o low that no structural 
variation can be sensed and shown within the area for 

30 two or more adiacent pixels forming the image . 
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In the strictly diagnostic field, for instance, in 
which, due to practical and economic reasons, the 
number of image pixels is generally limited to 256 x 
256 pixels for a two-dimensional image, encoding is 
5 extremely fast. In this cases a coding according to the 
method as disclosed with reference to figures 1 to 3 
may be used without suffering by a too high duration of 
the coding procedure. 

The encoding method as disclosed above, which 

10 includes the information about the aspect of a pixel 
with reference to the surrounding pixels and/or the 
time variations thereof, allows image processing 
methods which substantially require a recognition of 
the object type or of the quality of what is reproduced 

15 by the pixel, and allow to automatically recognize the 
type of object and/or the quality thereof by the same 
processing system or software. 

Figure 4 is a block diagram of a method of 
processing digital or digitized images, operating on 

20 the basis of the previously described encoding method. 

The processing method includes two steps : ! teaching 
the processing system and processing. J 

Processing is performed, per se, by an algorithm 
which is basically an algorithm for executing 

25 comparisons between a database that includes a certain 
number of identification vectors for pixels associated 
to the type of object or to the quality corresponding 
thereto and the identification vectors for pixels of an 
image to be processed. 

30 As a result of the comparison between the 
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identification vector for each pixel of the image to be 
processed and the identification vectors for the pixels 
included in the database, the comparison algorithm 
assigns to each pixel encoding vector within the ima ge 
to be processed, or to a predetermined portion thereof, 
the most appropriate or probable or the closest type of 
object or quality of the pixel identifying vector 
included in the database. 

The processing algorithm may be a simple 
discriminating algorithm, for instance an LOA algorithm 
(Linear Discriminant) (S.R. Searle, 1987, Linear Models 
for unbalanced data, New York, John Wiley & Sons) or a 
more complex algorithm, e.g. neural networks. The image 
processing procedure to be used is a typical 
15 application for neural networks, i.e. an application in 
which a very great number of typically simple 
operations is required, and which finds no exact 
numerical solution due to the considerable number of 
identical processing steps to be performed. In 
practice, a dull execution of the steps for comparing 
identification vectors for the image pixels to be 
processed, with the identification vectors for the 
pixels of the reference database, would require so lung 
computing times as to be unacceptable. 

A number of neural networks might be used, for 
instance those known as: MetaGenl, MetaGen, MetanetAf, 
MetaBayes, MetanetBp, MetanetCm (M.Buscema (ed) , 1998, 
SUM Special Issue on ANNs and Complex Social Systems, 
Volume 2, New York, Dekker, pp 439-461 and M.Buscema 
and Semeion Group ,1999, Artificial Neural Networks 
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and Complex Social Systems [in italian] , Volume 1, Rome 
, Franco Angeli, pp 394-413 and M.Buscema, 2091, Shell 
to program Feed Forward and Recurrent Neural ' Networks 
and Artificial Organisms, Rome, Semeion Software n.12, 
5 ver 5.0), TasmSABp, TasmSASn (M.Buscema and Semeion 
Group ,1999, Artificial Neural Networks and Complex 
Social Systems [in Italian], Volume 1, Rome , Franco 
Angeli, pp. 440-464), FF-Bm, FF-Bp, FF-Cm, FF-Sn et al. 
(D. E. Rumelhart, 0. E. Hinton, and R. J. 
10 Williams, 1986, Learning representations by back- 
propagating errors, Nature, 23: 533-536; M.Buscema, 2000, 
Squashing Theory and Contractive Map Network, Rome, 
Semeion Technical Paper n. 23i -23e; M. Buscema, 1995, 
Self -Reflexive Networks. Theory, Topology, 

15 Applications, in Quality & Quantity, Kluwer Academic 
Publishers, Dordtrecht, The Netherlands, vol. 29 (4), 
339-403, November). The publications describing the 
above neural networks shall be considered as a part of 
this invention. 

20 The teaching step consists in generating a 

database of pixel identification vectors which are 
uniquely associated to the type of object or. quality 
reproduced by pixels of digital or digitized images 
which are encoded as described above, and are 
25 interpreted on the basis of visual operations performed 
by qualified personnel. The identification vector of 
each pixel is associated to the type of object or 
quality of what is reproduced by the pixel, a list of 
object types or qualities of interest having been 
previously defined, consistent with the typical 
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subjects of the digital or digitized images used for 
teaching, hence for generating the knowledge database 
to be provided to the processing algorithm. 

The knowledge database for teaching the processing 
5 algorithm is provided or allowed to be accessed by the 
processing algorithm, depending on the specific 
teaching mode of the selected processing algorithm. 

At the end of the step for teaching the processing 
algorithm, a digital or digitized image of an image 

10 subject is encoded with the above described method, in 
a manner compatible with those used in the images 
designed to form the knowledge database and a list of 
object types or qualities is defined, among those 
included in the knowledge database of the processing 

15 algorithm. The processing algorithm substantially 
compares the identification vectors of the individual 
pixels generated by the encoding process, and assigns 
the most probable object type or quality of the 
reproduced object, to each pixel. 

20 The different indications of object types or 

qualities associated to each identification vector for 
image pixels are then displayed by printing lists 
and/or by differentially highlighting, e.g. by colors, 
the pixels of the image to be processed directly on the 

25 image . 

Depending on the total number of pixels and on the 
accuracy required by the list of object types or 
qualities reproduced in the individual pixels, either 
subsets of types or qualities or all the types and/or 
30 qualities may be selected. 
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The digitized or digital images may be two- 
dimensional or three-dimensional with reference to what 
has been described for the encoding method, or may 
consist each of a sequence of images of the same frame, 
as acquired at different instants. 

In greater detail, Figure 4 shows the two teaching 
and processing steps in which 10 denotes a set of 
digital or digitized images, both individually and in 
the form of image sequences. 11 denotes the procedure 
of encoding each pixel of said images into the 
corresponding identification vector. 12 denotes the 
step of uniquely associating the object quality or type 
as reproduced by each pixel to the corresponding 
identification vector based on the list of 
predetermined object types or qualities 13 and 14 
denotes the reference or teaching database ; for the 
image processing algorithm. 

In the processing step, a digital or digitized 
image or a set of said images, such as a sequence of 
images of the same frame, denoted as 18, is subjected 
to a step of pixel encoding into identification 
vectors, denoted as 19, and the identification vectors 
are provided to the processing algorithm 17, which is 
also supplied with a list of types or qualities 
specifically sought for and included in the list 13 
wherewith the teaching database 14 was prepared to be 
accessed by the processing algorithm 17. The 
processing algorithm assigns to each identification 
vector for the pixels of the image/s 18 an object type 
or a quality and the identification vectors are decoded 
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in 20 into the corresponding pixel, the latter being 
assigned any pixel aspect changes uniquely related to 
the typ® associated thereto, for instance a color or 
the like. The pixels marked thereby are displayed on 
5 the screen, e.g. over the original image /s and/or a 
list of the identification vectors for the pixels of 
the digital image/s to processed is printed, and/or the 
image displayed on the screen is printed. 

As an alternative thereto, the data provided from 

10 the algorithm may be used for further processing, based 
on the recognition of the object qualities or types 
reproduced by the individual pixels thanks to the 
processing algorithm. 

Any further processing or handling of the data 

15 provided by the algorithm may be performed by the 
algorithm itself or by other types of algorithms, 
depending on the desired functions or handling 
purposes . 

Hence, for example, the above processing method 
20 may be used to simply recognize objects, or qualities 
or conditions or statuses of the objects reproduced by 
pixels . 

This type of processing is advantageously used in 
the medical field, as an automatic support to reading 
25 and interpretation of diagnostic images, particularly 
radiographic images, ultrasound images, Nuclear 
Magnetic Resonance images, or the like. 

As an alternative thereto or in combination 
therewith, the method of the invention may be used to 
30 recognize shapes or types of objects in images with the 
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same subject and substantially the same frames, but 
being shot or acquired with different methods. In this 
case, each of the images of the same subject and 
showing substantially the same frame may be processed 
5 with the processing method of the invention, whereupon 
the pixels of the different images, having 
substantially identical positions therein and being 
associated to the same object type or object quality 
are shown in overlaid positions, thereby providing an 

10 image which contains the details of the same subject, 
as imaged with the three methods. This may be 
advantageous to integrate into a single image, details 
that may only be recognized and reproduced with some of 
the acquisition or imaging techniques or modes, as well 

15 as details that may be only recognized and imaged with 
other acquisition or imaging techniques . 

Similarly, the processing method may be used for 
image correction, e.g. to accurately correct defocused 
images . Here , by providing an adequate teaching 

20 database including the identification vectors of 
defocused images with a uniquely associated object type 
or quality reproduced by the corresponding pixel, the 
inventive method may be used to generate a focused 
image, by identifying the pixels which reproduce 

25 unfocused borders and removing or modifying them to 
obtain the focused image. 

The two applications as described above may be 
obviously used in the medical field. 

Particularly, by using the processing method to 

30 obtain overlaid images substantially of the same frame 
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of the same subject, all data obtained by different 
imaging techniques, e.g. ultrasound, radiographic and 
MR imaging may be integrated into a single image. 

It shall be noted that the possibility to 
5 recognize the different types or qualities of an object 
allows to integrate the information achieved by 
different imaging techniques even when the latter 
provides images of different frames of the same 
subject, while obviously accounting for the relative 

10 arrangement of said different frames in space. 

Figures 5 to 13 show the results of an emb odiment 
of the inventive method as applied to the medical field 
and to the purpose of supporting the diagnostic 
activity of the physician. J 

15 Particularly, the example as shown in Figs. 5 to 

13 relates to the use of the processing method for 
selective recognition of different types of tissues in 
diagnostic Nuclear Magnetic Resonance images. 



EXAMPLE 1 (Fig. 5) 



SUBJECT 


BREAST 


IMAGING METHOD 


NUCLEAR MAGNETIC RESONANCE 


PURPOSE 


RECOGNITION OF TISSUE TYPES 


TISSUE TYPES 


1. BENIGN TUMOR 

2. MALIGNANT TUMOR 

1 


PIXEL ENCODING 


3X3 PIXEL MATRIXES 

THE ENCODED PIXEL IS THE 

CENTRAL PIXEL 


IMAGE DEFINITION 


256x256 PIXEL 
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In the example 1, a teaching database for the 
image processing algorithm is generated to recognize 
two types of tissues, i.e. benign tumor and malignant 
tumor in the breast region. 
5 A predetermined number of Nuclear Magnetic 

Resonance images of the breast region of patients who 
have been diagnosed a malignant breast tumor and of 
patients who have been diagnosed a benign breast tumor 
are pixel encoded according to the method described 

10 above. The identification vectors for the pixels have, 
as components, all the surrounding pixels in a 3x3 
pixel matrix, in which the pixel to be encoded is the 
central pixel (Fig. 1) . 

The identification vector for each pixel is 

15 assigned the type of tissue reproduced by the pixel in 
the image. 

Therefore, the teaching database for the image 
processing algorithm contains identification vectors of 
image pixels relating to two tissue typas, i.e. 
20 malignant tumor tissues of the breast region and benign 
tumor tissues of the breast region. 

The following algorithms composed of so-called 
neural networks are used as processing algorithms. 
PROCESSING ALGORITHM 
MetaGenl 
MetaGen 
MetanetAf 
FF-Bm 
MetaBayes 
MetanetBp 
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MetanetCm 

FF-Sn 

TasmSABp 

TasmSASn 

FF-BP 

FF-Cm 



A sequence of Nuclear Magnetic Resonance linages of 
the breast region of different patients, which were not 
used for generating the teaching database are encoded 
as disclosed above with reference to Figure 1, and 
according to the pixel encoding method which is 
followed to encode the images used to create the 
teaching database for the processing algorithms. An 
example of these images is shown in Figure 8. The white 
ring denotes the presence of benign tumor tissue. 

The identification vectors for the individual 
pixels are provided to the processing algorithm for the 
recognition of the tissue type reproduced thereby. 

The algorithm assigns to the different 
identification vectors, hence to the corresponding 
pixels, the type of tissue represented thereby based on 
the teaching database. 

The result thereof is displayed by appropriately 
and differentially coloring the pixels whereto the type 
of benign or malignant tumor tissue has been assigned. 

Figure 9 shows a tissue type recognition result 
example referred to the image of Figure 8, in which the 
white outlined area had been recognized by visual 
analysis as representing the benign tumor tissue. 

In Figure 9, the black screened white zone 
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represents the pixels whereto the processing algorithms 
assigned the type of benign tumor tissue. 

The white encircled black zones denote the pixels 
whereto the processing algorithms assigned the type of 
5 malignant tumor tissue. 

As compared with the recognition of malignant or 
benign tumor tissue types, obtained through visual 
analysis by a physician, for some pixels the algorithm 

i 

provided non accordant indications, which have been 

10 temporarily classed as wrong. 

Figure 5 shows both in a data table and in a chart 
the prediction reliability results of tissue type 
recognition obtained by processing with the different 
neural networks as listed above. The results obtained 

15 therefrom are expressed in terms of correct benign or 
malignant tumor tissue recognition percentage, of 
recognition sensitivity and of weighted and arithmetic 
correct recognition average, as well as absolute 
errors . The chart only shows the two tissue type 

20 recognition percentages and the errors. 

The above description clearly shows the high 
tissue recognition reliability obtained ' by the 
processing algorithm , hence the high reliability 
provided by the processing method, when used as a 

25 diagnostic image analysis method, for recognizing and 
indicating the presence of types of tissues. ; 

It is apparent that this method is not a pure 
diagnostic method, because, although the indications 
provided thereby are highly reliable, they can provide 

30 no diagnostic certainty nor substitute or prevent the 
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execution of additional specific analyses or 
examinations needed for a totally reliable diagnosis. 

The method substantially provides support to 
diagnostic image reading and interpretation, aimed at 
5 better location and recognition of specific tissue 
types represented in the images. The difficulties in 
reading and interpreting diagnostic images, whether of 
the MRI and ultrasound or radiographic imaging types 
are self-evident from Figure 8 . 

10 Obviously, a better result may be achieved by 

changing the encoding rule, i.e. by increasing the 
number of surrounding pixels around the pixel to be 
encoded, which are designed to form the components of 
the identification vector of said pixel to be encoded. 

15 Better results were also achieved by increasing 

the number of the tissue types contained in the 
teaching database , as shown in the following examples. 

EXAMPLE 2 

20 The example 2 is similar to the example 1, an 

additional tissue type, i.e. normal tissue, being 
included in the recognition database. Hence, when the 
teaching database is generated, the encoded vectors for 
the pixels of the images are uniquely associated to one 

25 of the tissue types represented thereby, i.e. benign 
tumor tissue, malignant tumor tissue or normal tissue. 

This additional type allows to count on a greater 
number of pixels and corresponding identification 
vectors having a sure meaning. In the previous example, 

30 these pixel identifying vectors and the corresponding 
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pixels have no meaning for the processing algorithm, 
whereas in this second example, the processing 
algorithm can assign an additional well-defined class 
or type of tissue. 
5 This additional possibility provides an error 

reduction, since the algorithm may choose from three 
conditions or statuses to be assigned to the 
identification vectors . 

The execution of the example is exactly as 
10 described and shown with reference to the ' previous 
example 1 . 

In this example, only the following neural 
networks were selected as processing algorithms: 
PROCESSING ALGORITHM I 
MetaGenl 
MetaGen 
MetanetAf 
MetaBayes 
MetanetBp 
MetanetCm 
FF-Sn 
FF-BP 
FF-Cm 

The numerical results are listed in Figure 6. 
15 The recognition of tissue types by the different 

neural networks is more reliable. 
EXAMPLE 3 

The example 3 is similar to the above examples, but 
includes five tissue types, i.e.: benign tumor tissue, 
20 malignant tumor tissue, normal tissue, muscular tissue 
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and image background. 

The teaching database is generated as described 
above with reference to the previous examples and 
includes pixel identifying vectors , each being uniquely 
5 assigned one of the above five types, i.e. the one 
represented by the respective pixel. 

The tissue type recognition result per image pixel 
is shown in Figure 7 and for the following algorithms : 
PROCESSING ALGORITHM 
MetanetAf 
MetaBayes 

MetanetBp ! 

MetanetCm 

FF-Bm 

FF-Sn 

FF-Bp 

FF-Cm 

LDA 

All these processing algorithms, except LDA, are 
10 neural networks. LDA is a discriminating algorithm. 

The result achieved thereby proves a very high 
tissue type recognition reliability. It shall be 
further noted that the discriminating algorithm also 
provides unexpected results in relation to the 
15 capabilities thereof, when compared with normal 
conditions, although the results provided thereby are 
definitely lower than those obtained by neural 
networks . 

The chart shows the errors for each different 
20 algorithm. 
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Fig. 10 shows an example of result visualization 
by differentiated pixel coloring, depending on the 
different types recognized therefor, and with reference 
to the example of Figure 8. 
5 The muscular tissue, the background, the normal 

tissue and the benign tumor tissue are properly 
recognized. The indications detected in Figure 9, 
regarding the example 1, in which in some small 
portions benign tumor tissue was wrongly located, have 

10 disappeared herein. 

Figures 11, 12 and 13 show an example of Nuclear 
Magnetic Resonance digital photographs of a breast 
region including a malignant tumor tissue, as 
highlighted by a white ring in Figure 11 and by a 

15 corresponding partial enlarged view in Fig. 11. 

Fig. 13 shows the result obtained in terms of 
recognition of the tissue types reproduced by the image 
pixels, thanks to the method of the invention, 1 with the 
help of a neural network as a processing algorithm. The 

20 teaching database is the same as in the example 3, 
including all five tissue types. 

Correct recognition of malignant tumor, 
background, and muscular tissue is apparent from Fig. 
13, which shows an example of recognition processing 

25 result visualization. 

As regards the described examples and the 
processing method of the invention, it shall be noted 
that, while identical frames are always used in the 
figures of the examples, the described method is not 

30 necessarily limited to the type of frame. Thanks to the 
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fact that the encoding method according to the 
invention allows to account for the relation between 
the encoded pixel and the surrounding pixels, the 
teaching database actually allows to identify and 
5 recognize the tissue type reproduced by a pixel of a 
digital image of the same anatomic region or possibly 
of different anatomic regions, regardless . of the 
specific image frame. 

This considerably simplifies imaging, as it does 
10 not require images to be always acquired with the same 
frame. 

It shall be further noted that the teaching 
database may dynamically grow by the addition of data 
gathered and confirmed through successive processing 

15 procedures. In fact, once the tissue type assignment by 
the algorithm to a predetermined pixel and to the 
corresponding identification vector has been confirmed, 
the identification vector-tissue type pairs so formed 
may be themselves loaded in the teaching database which 

20 grows with the use of the method, thereby making the 
processing algorithm increasingly expert and reducing 
the indecision or error margin. * 

It shall be additionally noted that, by simply 
adding a tissue type to be recognized and assigning it 

25 to pixel identification vectors of images used to 
generate the teaching database, and which reproduce 
said tissue type, the recognition processing may be 
changed as regards the number of different tissue types 
to be recognized. 

30 B Y totally changing the teaching database, it is 
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possible to recognize other tissue types in other types 
of subjects, and to correct or overlay images of the 
same subject, obtained with different techniques. 

Image processing aimed at recognizing tissue types 
5 or qualities is also possible by a pixel vector 
encoding method, which accounts for time variations of 
the pixel reproducing a specific object, i.e. the type 
according to the encoding example of Figure 3. As 
disclosed above, this encoding type allows to encode 
10 pixels of image sequences. 

In the diagnostic field, a tissue recognition 
method may be provided for moving subjects, such as in 
the case of ultrasound imaging or similar, of the 
heart . 

15 Currently, upon the control of the 

electrocardiogram, sequences of ultrasound images of 
the heart region are acquired, to be further stored and 
displayed successively like in a movie sequence. The 
interpretation of the images within the sequence, 

20 especially with reference to specific diseases is not 
easy and is relatively uncertain. Hence, thanks to the 
processing method as described with reference to the 
examples 1 , 2 and 3 , as combined with a method of 
encoding image pixels of image sequences of the same 

25 type as described with reference to Figure 3, an 
automated analysis and recognition of the tissue types 
reproduced by the individual pixels of the image 
sequence may be performed, whereupon said types may be 
highlighted in a differentiated manner, over the 

30 sequence images, to improve the viewing and locating 
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potential of the physician or the qualified personnel. 

A similar application field for a combination of 
the processing method for tissue type recognition in 
digital or digitized image sequences with a pixel 
5 encoding method for the pixels of said sequence images , 
respectively by an identification vector including , for 
each pixel, the values of the pixel to be encoded and 
of the pixels around it, of each image of the image 
sequence, consists in the recognition of tissues or 
10 vascular or lymphatic flows in combination or not with 
the injection of contrast agents, as well as in the 
recognition and measurement of contrast agent 
perfusion. 

In this case, the sequence of images acquired with 
15 time after the injection of contrast agents is encoded 
with the method as described with reference to Figure 
3. The teaching database for the processing algorithm 
includes behavior types, e.g. arterial blood flow or 
lymphatic or venous flow and stationary tissues and/or 
20 tissues of vessel walls. Then, the recognition results 
are displayed e.g. by appropriately coloring the pixels 
relating to the different types . 

In all the above cases, it is important to 
generate an adequate teaching database containing the 
25 relevant object types or qualities for the specific 
examination . 

It shall be noted that the same processing unit, 
i.e. the hardware wherein the processing software is 
loaded, may perform any of the above recognition 
30 processing procedures, by simply providing the 
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processing software with the proper teaching database 
for the images to be processed and by obviously 
encoding the images to be processed. 

Regarding image correction procedures, i,e. image 
5 processing aimed at suppressing or recognizing 
artifacts and/or at recognizing defocused areas and at 
correcting them by focusing the image, the processing 
method of the invention does not substantially change. 

As regards artifacts, a teaching database shall be 

10 generated in which known images with or without 
artifacts are encoded, by assigning the artifact type 
to artifact-reproducing pixels and the correct pixel 
type to correct object reproducing pixels. Once an 
image or a sequence of images has been recogaized, it 

15 may be easily corrected by suppressing artifact-related 
pixels or by assigning to artifact-related pixels the 
tissue types or qualities which they might have with 
reference, for example, to surrounding pixels. 

Defocusing may be corrected in a similar manner. 

20 The processing method of the invention may be also 

advantageously used to generate images composed of 
individual images of the same subject as obtained by 
different techniques, e.g. Nuclear Magnetic Resonance 
imaging, ultrasound imaging and x-ray imaging. 

25 In this case, the teaching database will contain 

pixel encoding vectors for all three images obtained 
with the three different techniques, with tissue types 
or qualities corresponding to said pixels being 
uniquely associated to said vectors. Hence, image 

30 portions are uniquely associated to specific tissue 
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types and said well-defined portions may be displayed 
in overlaid positions or other combined arrangements 
within a single image. j 

An additional application of the inventive 
recognition method, in combination with imaging 
methods , particularly for diagnostic purposes, such as 
ultrasound or Nuclear Magnetic Resonance imaging 
methods, consists in that imaging is performed with 
less accurate but considerably faster imaging sequences 
or techniques and that the displayed image is ! an image 

processed with the recognition method of this 

j 

invention . 

This allows to maintain high reliability levels in 
the recognition of the types or qualities reproduced by 
15 the individual image pixels and to shorten the 
diagnostic imaging times. This arrangement may be very 
useful particularly for ultrasound or Nuclear Magnetic 
Resonance imaging, which require relatively long 
imaging times, in certain situations, and provides 
20 apparent advantages. 

The processing method of the invention also 
provides considerable advantages in the recognition of 
tissue types, like potentially diseased tissues, for 
example' tumor tissues at very early stages. Currently, 
x-ray mammography, for example, is performed with 
spatial resolutions of about 7 micron. Therefore, these 
images or the data associated thereto have such a 
resolution that different tissue types may be 
discriminated at very early growth levels, in groups of 
a few cells. Nevertheless, the human eye only has a 



25 



30 
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spatial resolution of 100 micron. Hence the 
considerable imaging resolution cannot be currently 
used. 

Conversely, the method of this invention does not 
5 have any spatial resolution limits, except those 
possibly associated to image digitizing means . 

Therefore, the spatial resolution limits of the 
human eye may be lowered by using appropriate image 
digitizing or digital sampling means, to potentially 
10 reach the spatial resolution available at the imaging 
stage. 

Therefore, by using the method of this invention, 
it is possible to generate a digitized virtual image 
which consists of a two-dimensional, three-dimensional 

15 or multi-dimensional set, in which the virtual image is 
composed of image data for image unit dots relating to 
the spatial resolution below the one of the human eye. 

The processing method essentially includes the 
same steps as described above, i.e. generating pixel 

20 encoding vectors and quality and type recognition 
processing, particularly for tissues, as described 
above. As described herein, the different object types 
or object qualities may be highlighted by appropriately 
changing the aspect of the pixel related thereto, e.g. 

25 by a suitable differentiated coloring arrangement. 

From the set of pixel identification vectors, the 
pixel data matrix may be reconstructed, and said data 
may be used to control, for instance, a printer and/or 
a display screen. 

30 The printer or display may be controlled in such a 
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manner as to allow the individual pixels to be also 
displayed at the resolution of the human eye, e.g. by 
using an image variation in which the data of each 
pixel of the high resolution image, i.e. having a 
5 resolution below that of the human eye is used to 
control a unit group of pixels of the display or 
printer, whose pixels take the same aspect as the 
corresponding pixel to be displayed. The image is 
inflated rather than enlarged, each high resolution 
10 pixel being represented by displaying a pixel sub- 
matrix which comprises a sufficient number of pixels to 
generate an image portion having a resolution of the 
same order of magnitude as the one of the human eye or 
higher . 

15 In the case of an image composed of pixels whose 

size corresponds to a resolution of 7 micron, it is 
possible to form unit groups of 14 x 14 = 196 pixels, 
thus simulating a resolution of 98 micron. ! 

Here, the 196 pixels of the unit group are 

20 controlled to assume the same aspect as assigned to the 
corresponding high definition pixel, thereby generating 
an image point which is visible to the human eye. 

Obviously, the above displaying steps allow to 
generate unit groups of high definition pixels which 

25 may also have a greater or smaller number of pixels, 
substantially corresponding to a greater or smaller 
enlargement of the individual high resolution pixels. 

The enlargement factor may be also user-preset by 
possibly allowing to delimit or define an image portion 

30 whereto the enlargement displaying step is to be 
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applied and to modify said image portion to be enlarged 
for successive and different enlargement steps with 
different enlargement and resolution factors. . 

The above description clearly shows that the 
5 recognition method according to this invention, based 
on the pixel encoding technique allows to i process, 
evaluate or provide highly reliable indications, even 
regarding such information that is unrecognizable for 
the human eye. 

10 Obviously, as for the method described above, 

multiple application fields may be provided, with 
particular reference to diagnostic image processing and 
to healthy or normal tissue or diseased tissue 
recognition, especially for benign and malignant tumor 

15 tissues . 

In the latter application field, the improvement 
as described above allows to analyze the tissue type 
and to obtain indications regarding the presence of 
benign or malignant tumor tissues at very early stages 
20 which, at a resolution of 7 micron, are composed of a 
very small number of cells. 
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